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Abstract 

In this paper, we analyze the numerical stability of the popular Longley-Rice Irregular Terrain 
Model (ITM). This model is widely used to plan wireless networks and in simulation- validated 
research and hence its stability is of fundamental importance to the correctness of a large amount 
of work. We take a systematic approach by first porting the reference ITM implementation to a 
multiprecision framework and then generating loss predictions along many random paths using real 
terrain data. We find that the ITM is not unstable for common numerical precisions and practical 
prediction scenarios. 

1 Introduction 

The Irregular Terrain Model (ITM) is a well known and widely used model for predicting propagation 
loss in long (greater than one kilometer) outdoor radio links. This model, in its most widely used 
incarnation, was developed by HufFord et al. in [T] at the National Telecommunications and Information 
Administration (NTIA) Institute for Telecommunications Sciences (ITS) based on work done in 1978 by 
Longley [2] . The model predicts the median attenuation of the radio signal as a function of distance and 
additional losses due to refractions at intermediate (terrain) obstacles. Compared to the vast majority 
of other models, even those that are similar in approach (e.g.. The International Telecommunications 
Union (ITU) Terrain Model [3]), the ITM is very comphcated, requiring the interaction of dozens of 
functions that implement numerical approximations to theory. Despite its age, the ITM maintains a 
substantial popularity, possibly due to the fact that it was extensively validated in the 1970s for planning 
analog television transmissions, and that a reference implementation is available. Today, it is used in 
several popular coverage mapping and network planning tools (e.g., [HIS]) as well as network simulation 
applications (e.g., [SlIZ])- As a result, it is also used widely in current wireless networking research (e.g., 
[Hlin]), emerging government standards (e.g., [TO]), and persists at the foundation of other modern path 
loss models such as ITU-R 452 [TT]. Due to the ITM's complexity and its simultaneous popularity, the 
question of numerical stability is an obviously important one, but to our knowledge has not previously 
been investigated. 

We take a systematic empirical approach to the analysis that involves porting the defacto C++ 
implementation of the ITM to a multiprecision framework. A comparison is made between the 
predicted path loss values for many randomly generated links over real terrain data. Model parame- 
ters are also varied in order to produce a fully factorial experimental design over a range of realistic 
parameters. In the end, the results show that while the model performs disastrously for half-precision 
(16 bit) arithmetic, it is well behaved for single-precision (64 bit) and higher precisions. Within the 
values tested, there are only very few isolated cases that result in significantly different (greater than 3 
dB) output and these tend to result from a single change in branching decision in the approximation 
algorithms and not because of massive information loss. While this sort if empirical analysis cannot be 
used to extrapolate to any parameters and any terrain model, we are able to say that over realistic links 
the model appears to be well behaved. This result provides confidence in the stability of the output of 
the ITM model as well as other similar models that compute diffraction over terrain (e.g, [3l [TT]). 
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Frequency (MHz) 


0.148, 80, 900, 1900, 2400, 5280, 60000 


Climate Code 


1 (Equatorial), 2 (Continental Subtropical), 
3 (Maritime Subtropical), 4 (Desert), 
5 (Continental Temperate), 6 (Maritime 
Temperate on land), 7 (Maritime 
Temperate at Sea) 


Permittivity / Conductivity 


5/0.001 (Poor Ground), 13/0.002, 
15/0.005 (Average Ground), 
25/0.02 (Good Ground), 80/5.0 
(Sea Water) 


Tx/Rx Height (Meters) 


Uniform random: U{0, 35) 


Tx/Rx Location 


Uniform random within bounding box. 


Precision (Bits) 


11, 24, 53, 64, 128, 256, 512, 1024, 
32-bit Intel native 



Table 1: Experimental parameters 



2 Implementation 

The implementation involves a line by line port of the reference ITM implementation to have multi- 
precision support. By and large, this involves using multiprecision data structures in place of native 
machine number formats. To this end, we make use of the MPL, MPFR, and MPC libraries P^fHllTS] . 
The MPFR library wraps the MPL library and provides additional necessary features such as a square 
root function, computation of logs and powers, and trigonometric functions. The MPC library provides 
support for complex arithmetic. In porting, a line like: 

fhtv=0.05751*x-4.343*log(x) ; 

Must be replaced with: 

mpf r_log(tmp,x,R) ; 
mpfr_mul_d(tmp,tmp,4.343,R) ; 
mpf r_mul_d(fhtv,x,0. 0575 1,R) ; 
mpfr_sub(fhtv,fhtv,tmp,R) ; 

Although it may be possible to automate this process, we proceeded manually in order to avoid introduc- 
ing bugs. In porting, the refernce ITM source is modified to take an additional command line argument 
that specifies the precision in bits, which is passed to the multiprecision framework. Otherwise, the 
functionality and usage is identical to the machine-precision ITM implementatior0. 



2.1 Experiment 

Our experimental design involves generating random link geometries within a latitude and longitude 
bounding box. For each random link, a path loss prediction is made both with the machine precision 
(64-bit double precision arithmetic) reference implementation and multiprecision implementation (at a 
variety of precisions). After the fact, we can quantify the differences in predictions and investigate any 
outliers or general trends. 

For the bounding box we use 39.95324 to 40.07186 latitude and -105.31843 to -105.18602 longitude 
in the WGS84 datum. This box contains a portion of the mountainous region to the west of Boulder, 
Colorado, as well as the plains to the east, providing a realistic mix of topographies. 500 links are 
generated uniformly at random within the box. For each random link, we try a range of reasonable 

^Our multiprecision implementation is available at |http : //systems . cs ■ Colorado . edu/research/wireless/ [ 
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Figure 1: Terrain (Digital Elevation Model) data for area within geographic bounding box. The plotted 
grcyscalc color varies from white (1562.15 m) to black (2550.28 m). Rolling hills and mesas (light grey) 
are at « 1700 m, or 140m above the Colorado plateau. 
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parameter values, which are summarized in table [TJ Antenna heights are selected uniformly at random 
between and 35 meters. For each link, the corresponding elevation profile is extracted from a publicly 
available United States Geological Survey (USGS) Digital Elevation Model (DEM) with 0.3 arcsecond 
raster precision. Extraction and coordinate transformations are performed with the Geospatial Data 
Abstraction Library (GDAL) |16| . By trying each unique combination of parameters with a random link 
and random transmitter heights, we must make 122,500 predictions at each precision. We evaluate 8 
precisions ranging from half- precision (11 bits mantissa, 16 bits total) to 1024 bits along with the native 
32-bit (64 bit double precision arithmetic) machine precision. This results in 1,102,500 predictions total 
total. Although this takes some time to compute, it can be parallelized trivially. 



3 Results 

Figure[2^ shows the overall results of this experiment: the error (e) between the multiprecision prediction 
and the machine precision prediction is plotted. Half-precision arithmetic (11 bits of mantissa, 16 bits 
total) produces results that vary wildly. Above this, however, beginning at single precision (23 bits 
of mantissa, 1 bit of sign, 32 bits total), the two programs make very similar predictions. Figure 
provides a more detailed picture of these remaining cases. Much of the small error is negligible as it is 
presumably a function of differences in rounding. In the results, there is one clear outlier that produces 
a 6 dB difference. We investigated this case and found that it was the result of a difference in a branching 
decision that chooses whether or not to make a particular correction. It is not clear that one direction 
down the branch offers a better prediction than another, so this case can be safely ignored. 

Finally, we investigated the performance, in terms of running time, for the various precisions (on an 
otherwise unloaded machine). The multiprecision version is not substantially slower than the machine 
precision implementation — nearly all precisions take the same amount of time to run. At each precision, 
there are some number of outliers, which require slightly more time, but it is not clearly a function of 
precision. Hence, if it were the case that the multiple precision implementation was also safer, then its 
use would be clearly preferable. 



4 Conclusions 

Although it is not possible to extrapolate universally from these results, they demonstrate that the 
ITM is not substantially unstable for typical problems and reasonably precise numeric types (i.e., single 
and double precision IEEE formats). An analytical investigation of stability would go a long way to 
determine the stability universally, but is a substantial undertaking that involves the careful dissection of 
dozens of complex algorithms that combine to create the ITM implementation. A motivated investigator 
may choose to focus his effort on the knife-edge diffraction approximation algorithm, which is almost 
certainly the most numerically complex component of the model. For most practical purposes, however, 
the results presented here are sufficient to justify continued use of this model with the confidence that 
under typical situations it is not significantly affected by rounding and cancellation errors. 



^lEEE 754-2008 requires subnormal arithmetic rounding, which is not done natively by the MPFR library. The majority 
of rounding (excluding this special case) are identical. 
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Loss Value Prediction By ITIVI as a function of Precision 
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(a) All Precisions 
Loss Value Prediction By ITM as a function of Precision 
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(b) Single-Precision and Greater 



Figure 2: Box and whiskers plot of error as a function of precision. The zero-bit case is the machine- 
precision reference implementation. 
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